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1 Abstract 


The goal of this research is the development of a technique for vehicle navigation and control in the 
presence of obstacles. A potential function has been devised that peaks at the surface of obstacles 
and has its minimum at the proper vehicle destination. This function is computed using a systolic 
array and is guaranteed not to have local minima. A feedforward neural network is then used to 
control the steering of the vehicle using local potential field information. In this case, the vehicle 
is a trailer-truck backing up. Previous work has demonstrated the capability of a neural network 
to control steering of such a trailer-truck backing to a loading platform, but without obstacles. 
Now, the neural network has been able to learn to navigate a trailer-truck around obstacles while 
backing toward its destination. The network is trained in an obstacle free space to follow the 
negative gradient of the field, after which the network is able to control and navigate the truck to 
its target destination in a space of obstacles which may be stationary or movable. 
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2 Introduction 


The methods of backpropagation and backpropagation- through-time [1,2,3] are useful in many 
neural-control applications [4, 5, 6, 7, 8]. Nguyen and Widrow have successfully used the technique 
to train a multi-layer neural network to act as a nonlinear state feedback controller for backing a 
trailer-truck to a loading dock [6,7]. This paper examines a computationally efficient method of 
modifying the work of Nguyen and Widrow to permit truck backing in the presence of obstacles. 

Robotic path-planning and obstacle avoidance has been approached successfully using a variety 
of techniques [9,10,11,12]. For example, Khatib has proposed a method of obstacle avoidance 
for robotic systems using artificial potential fields defined in “operational space” 1 . Using this 
method, a potential field in the vicinity of obstacles induces repulsive forces on the robot [10]. 
When combined with an acceleration term toward the goal and the robot’s dynamic equations, 
it is possible to calculate analytically the desired trajectory and control forces. Variants of this 
formulation have been used by others as well [13,14,15,16]. 

The analytical nature of the artificial potential fields used by Khatib does not lend itself directly 
to a neural network implementation. However, the concept of low-level control and navigation based 
on such potential fields is quite useful and motivates the technique for truck-backing presented in 
this paper. The backing trailer-truck is the vehicle model used in this study for the development 
of learning systems which are capable of navigation in the presence of obstacles, nevertheless, the 
method is applicable to other vehicles. 

In this paper, a hybrid network technique for truck navigation based on potential fields is 
presented. The technique involves the calculation of a potential field using a systolic array as 
shown in section 3. Several algorithms for the systolic array are presented and the properties of 
the resulting fields are analyzed. This is followed, in section 4, by a discussion of how a multi-layer 
feedforward neural network can be trained to use local potential field information to control truck 
steering. 


3 Potential Field for Navigation 

The role of the potential field is to distribute information about obstacle and goal locations through- 
out operational space, thus providing local information about how to solve the global navigation 
problem. A field is developed which is a measure of the penalty associated with a given location in 
obstacle space. A secondary controller can then use that local information to navigate by attempt- 
ing to follow the negative field gradient. This field directs the truck toward the goal and away from 
obstacles. In light of its role, the potential field should possess certain properties: 

j The field should decrease as the goal is approached so that following the negative gradient 
will drive the truck toward the goal. 

j operational space: space in which avoidance task is defined as opposed to a transformed joint space [10] 
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2. The field should increase rapidly in the vicinity of an obstacle to avoid collisions. 

3. The field should have a single local minimum (the goal) to prevent the truck from getting 
trapped at some undesired location. 

3.1 Notation 

3.1.1 Operational Space Representation 

Obstacle representation directly affects the choice of algorithms used to solve the obstacle avoidance 
problem. In previous works, obstacles have been represented in many ways, including polygons [11] 
and sets of known object shapes (squares, circles etc.) placed at specified coordinates [10]. 

In this work, navigation takes place within a 2 dimensional operational space. The space is 
partitioned by a rectangular lattice with grid spacing 6 into grid-squares whose centers are at 
lattice points. A particular lattice point is denoted by n+j = (i6, j 6 ) and the grid-square that 
contains it is denoted by y,j. With these definitions we can specify obstacles as sets of such grid- 
squares which corresponds to regions of operational space where the truck cannot navigate. The 
set of lattice points associated with obstacles is denoted by (9. The target destination for the 
truck is called the goal and is denoted by tiq. It is assumed that the goal is located at a lattice 
point and is not contained within an obstacle. This representation, and the proposed algorithms, 
presumes that obstacle locations within operational space are known, possibly via an over-head 
camera. An example obstacle space, which will be used throughout this paper, is shown in figure 1. 
The boundary of the operational space will also be considered as an obstacle or barrier. 

A notion of lattice point neighbors is needed to discuss the potential field algorithms. 

Definition 1 (Neighbor) Two lattice points are said to be neighbors if they are separated by 
distance <5. The set of 4 neighbors for a lattice point, riij , will be denoted as 

^ 4 ^ 71 % j) = {°*+1,,7 j TZtJ— l}- 

Two lattice points will be called extended neighbors if they are separated by distance 8 or 8 \/ 2. 
The set of 8 extended neighbors for a lattice point, will be denoted as 

= Tli+lJ+ 1) — 1) 1) lij+l}’ 

A concept of “connectedness” for lattice points will also be useful. This definition is similar to the 
notion of “path connected” when speaking of a subset of 9? n and describes whether there exists a 
path between two points which does not cross an obstacle. Defined formally we have: 

Definition 2 (Lattice path-connected) Lattice points n a and n will be called lattice path- 
connected if there exists an ordered set of lattice points, p a \> = £ (9, called the 

path, such that ni = n a , tin = n bi and n t +i € A^n,*). A similar concept of extended-lattice 
path-connected can be defined using N & () instead of N 4 Q, 
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goal 




Figure 1: A sample obstacle space. Obstacles are represented by black squares in a rectangular grid. 
3.1.2 Systolic Array for Computing Potential Fields 

The regular representation of obstacles on a grid as presented above permits computation of the 
potential field by a set of simple, identical processors arranged in a rectangular array (one processor 
associated with each lattice point, n t j). Each processor senses whether the corresponding lattice 
point is contained in an obstacle, that is whether n # -j € O. The processor then computes the local 
level of the potential field by interacting dynamically with neighboring processors. Such a structure 
is a type of systolic array. We introduce the following definitions: 

Definition 3 (Lattice potential field) The potential field, denoted by $ x ,y{k) } is a 2-D function 
giving the value of the potential field at time iteration k at location (x,y). The set of values of the 
potential field at the lattice points n tJ at time iteration k define a lattice potential field, 

Definition 4 (Lattice local minimum) A lattice point, n a , will be called a lattice local mini- 
mum of if $n a < ®n b Vn*, e iV 4 (n a ). Likewise, n a , is said to be an extended-lattice local 

minimum of 4> tJ if $„ 0 < $ n6 Vn& € Ns(n a ). This conveys the notion of whether or not there is 
a neighboring point which is “downhill” from the current point. 

The various methods presented for calculating the potential field involve relaxation of the inter- 
connected processors while subjecting them to obstacle and goal positions. The specific relaxation 
equation implemented by all of the processors determines the properties of the potential field. We 
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develop a set of such equations in this paper, and examine the properties of the resulting potential 
fields. 


3.2 Single Layer Relaxation Methods 

In this section two relaxation methods are presented which seem most intuitive but which do not 
produce desirable potential fields. These methods are presented as motivation for the slightly more 
complicated method presented in section 3.3. 


3.2.1 Local Averaging Relaxation 


An obvious relaxation implementation is to fix the outputs of the goal-processor and obstacle- 
processors at two different levels while allowing the other processor outputs to converge to inter- 
mediate values by averaging the outputs of their nearest neighbors. The equations governing this 
process are: 


*«( 0) 
<M* + 1) 


0 


\ ($<+ lj(fc) + + $ij+i(fc) + *ij- 1 (*)) for 


0 


for 

for 


f $ 0 

1 n i,i + n G 

nij e O 

n iJ = n G 


( 1 ) 


This results in a field which decreases smoothly toward the goal, and increases toward obstacles. 
Convergence of the relaxation equations is easily shown by noting that forms a bounded, 

non-decreasing sequence in Jfc for each However, a unique local minimum, as defined above, is 
not guaranteed. It is possible, albeit rare, to have a point, n 0 nc, where $„ a = $ nt , Vnj G N 4 (n a ). 
This approach also has more serious problems. 


First, as can be seen in the example of figure 2, the field increases approximately logarithmically 
away from the goal. This can be derived by rearranging the relaxation equation 


+ $«-iJ + $*j+ 1 + 


( 2 ) 


into two separate terms 

0 = ($<+ij — 2$,j + + ($i,.i+i - 2^t,j + (3) 

Noting that each term approximates a second-derivative, this equation is then converted into a 
continuous model, 

(4) 


5 2 $ n 
+ — = 0 


dx 2 dy 2 

If we assume circular symmetry of the solution, the equation can be rewritten in terms of radius, 
r: 

£> 2 *. 1 

( 5 ) 


a 2 * 1 _ 


dr 


dr 
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The solution to this Euler equation is 

$(r) = Ci+C 2 lnr (6) 

The reader may note that the local- averaging calculation is equivalent to the numerical solution of 
Laplace’s equation. The logarithmic growth rate implies that the resolution required in estimating 
the gradient of the field grows linearly with the distance from the goal. Using the feedforward 
neural-controller described in section 4, a linear growth rate of the field, requiring a constant level 
of accuracy for gradient estimation, is more desirable. Second, there is no parameter which controls 
the rate of growth. Hence, the resolution of the obstacle grid cannot be changed without affecting 
the cross-sectional shape of the potential field, nor can the radius of influence of obstacles be 
adjusted. Finally, for regions of operational space partially shielded from the goal by obstacles, the 
field is effectively “pinned” to the upper value of the potential field. 



Figure 2: Local- averaging 


relaxation solution showing the undesirable logarithmic growth rate . 


3.2.2 Distance-to-Goal Relaxation 

In an attempt to correct the undesirable growth rate, a different technique is considered. This 
technique involves the calculation, for each field point, of the minimum distance to the goal along 
lattice paths not intersecting obstacles. The distance measure used here is a “city block metric.” 
The relaxation equations are: 


**(0) 

= 0 

' <W*), ' 





= 1 + min < 


► for 

f ". J l O 

\ n. j ^ n G 

(7) 

+ 1) 

« oo 


for 

n ij € O 


*m(*+ i) 

= 0 


for 

n.j = n G 
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This technique produces the desired linear growth rate. Furthermore, convergence of this method 
to a solution with unique local minimum is guaranteed, (the proofs are similar to those in lem- 
mas 2 and 3). This method, however, does not provide a mechanism for repelling the truck away 
from obstacles. There is no penalty for coming close to an obstacle, only a mechanism for preventing 
a path from crossing through an obstacle. 

3.3 A Two Layer Relaxation Method 

A method which combines the obstacle repulsion property of the local-averaging technique with 
the linear growth-rate and unique local minimum properties of the distance-to-goal technique is 
presented next. The method relies on a 2-layered approach. A first processing layer uses the 
obstacle positions to compute a barrier-potential field, A second processing layer uses the 

barrier-potential field and the goal position to compute an overall potential field, 


3.3.1 Barrier-Potential Field 


The barrier-potential field, is designed only to spread information about obstacle locations to 
surrounding nodes and therefore ignores the location of the goal. The relaxation equations are: 


*&(o) 

*?.,-(* + i) = 


*?,#(* + 1) = 


0 


max < 


max 


0^ 

1(*)’ 



a ^ 



•f-u+iW. 

a 


a 


a 

*&+ 1(*)> 

Oc 

*?j- 1(*) 


for 


for 


mjtO 


mj € O 


( 8 ) 


The result of applying the calculation to the obstacle pattern presented earlier is shown in 
figure 3. The barrier potential field, $fj, decays geometrically away from obstacles. The geometric 
ratio, a, is used to control the effective radius of influence of obstacles. 


3.3.2 Overall Potential Field 

The overall potential field, $£ , measures a “generalized distance” from each lattice point to the 
goal. The generalized distance consists of the weighted sum of two terms. The first is an “extended 
city block distance” from the point to the goal along the “best” path. This is similar to a “city 
block metric,” except that paths are allowed in 8 directions instead of the usual 4. The second term 
measures the cumulative barrier potential, $fjt along the path. Thus, the potential field, has 
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Figure 3: Barrier potential field for the example obstacle pattern (oc — 0.6,). Square sizes represent 
the values of 

the effect of stretching out the distance metric in the vicinity of obstacles, hence favoring paths 
which steer clear of obstacles. The relative weighting of city-block distance vs. barrier-penalty is 
controlled using the parameter The “best” path in question is the path which minimizes 

this generalized distance. The neural-controller uses this overall field to perform the navigational 
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After 3>f has converged, the minimum-distance path from a random initial lattice point can be 
found by repeatedly moving to the nearest neighbor with smallest . Setting $ moI sufficiently 
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large prevents this minimum-distance path from ever “punching through” an obstacle rather than 
going around it, no matter the length of the path. The values of calculated for the example 
obstacle pattern are shown in figure 4. 



Figure 4: Overall potential field ^ ar = 50, a = 0.6^. Square sizes indicate the level of&fj. 


3.3,3 Features of Two Layer Relaxation Method 

The two-layer relaxation method and the resulting lattice potential field have several desirable 
properties which will be explained in this section. 


Finite Convergence Time — The relaxation process consists of a set of iterated equations. In 
lemmas 1 and 2, we show that the iterative process converges in a finite number of steps to a unique 
set of values. The convergence time of is proportional to the maximum separation of obstacles 
and the convergence time of is proportional to the length of the longest minimum-distance 
path to the goal. 

Lemma 1 The barrier potential field , computed by equation 8 , converges in a finite number of 
steps. 

Proof. Consider any point not in an obstacle, n a O. There exists a minimum length path, 
PQ a = {m, • ■ * , n^r}, from some obstacle to the point, where ni G O and n/y = n a . Now assume 
that at iteration Jb, the lattice point n k = {poa} k converges to its final value. The minimum-length 
path from ni to n k +i is along the same path, {n\ } ■ * • , n^+i}. So, at iteration k + 1, n^+i ~ 7 n k- 
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Thus, njb+i, converges to its final value in k 4- 1 iterations. Since n\ converges at time iteration 1, 
by induction n # converges to its final value in N iterations. ■ 


Lemma 2 The generalized distance-to-goal potential field, computed by equation 9 , converges in a 
finite number of steps for all points , riij , extended-lattice path- connected to the goal , no- 
Proof. Consider any such point, n 0 . By assumption, there exists a minimum distance path, 
PGa = {ni, ■ • ■ , n^r}, from the goal to the point, where nj = no and njq = n a . Now assume that 
at iteration Jfc, the lattice point n ^ = {poa)k converges to its final value. The minimum-distance 
path from the goal to is clearly {ni, • * - , n* +1 }. So, at iteration k + 1, j = 7 + Thus, 

n*+i, converges to its final value in it + 1 iterations. Since n 1 — no converges at time iteration 1, 
by induction, tin converges to its final value in N iterations. ■ 


Although these proofs assume certain initial conditions for and it is stated without 
proof that the field computations will converge to the same values for any initial conditions. Thus, 
if the obstacle pattern changes at time iteration Jfc, &ij(k) and $?j(k) can serve as the new initial 
conditions. This facilitates tracking of moving obstacles. 


Single Minimum — In previous works such as [10,13,16], the computation of the potential field 
consisted of three steps. First, an obstacle- repulsor field was computed. This field decayed from 
some maximum value at the surface of obstacles to zero far from obstacles. Second, a uniform, 
global basin of attraction with minimum value at the goal was constructed. Finally, the overall 
potential field was computed by superimposing these two fields. Such a scheme, however, often 
resulted in local minima of the field “uphill” from obstacles. Volpe and Khosla have proposed the 
use of superquadric functions in the construction of artificial potential fields to prevent the creation 
of such local minima [16]. However, they found that the technique did not solve the problem of 
local minima caused by obstacles containing large concavities pointing away from the goal. 

Using the method proposed here, serves the role of a obstacle-repulsor field. However, a 
global basin of attraction is not computed independently of the obstacle-repulsor field. Rather, 
the overall potential field, contains cumulative information about <t )fj along the best path to 
the goal. This fact is essential in preventing undesirable local minima. Figure 5 shows a sample 
potential field calculated by directly adding the obstacle-repulsion field, , to a simple distance-to- 
goal field. Notice the local minimum occurring in the concavity “uphill” of the obstacle. However, 
as can be seen in figure 6, the potential field calculated using the cumulative method has no 
such spurious local minimum. A proof of this property is given in lemma 3. 

Lemma 3 The lattice field, calculated by 2-layer relaxation contains a unique local minimum 
at no over the set of lattice points which are extended-lattice path- connected to no* 

Proof. Clearly $fj(Jfc) > 0 Vfc. Therefore, by lemma 1, converges to > 0. Now, for all 
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Figure 5: Potential field computed by adding j to a distance~to-goal field has a local minimum 
a uphill ” of the obstacle . 



Figure 6: Potential field using cumulative has no local minima. 
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points extended-lattice path-connected to goal, the calculation of converges by lemma 2. Now, 
assume there exists a point, n a ^ n<2, which is a lattice local minimum of $,*j. By assumption, 
$„ 0 < Vn& £ Ng(n a ). However, since n 0 ^ no, by equation 9 there exists n 5 £ Ng(n a ) such 
that $ na = 7 + which contradicts the assumption. ■ 


Potential Field Cross-Sectional Shape — The cross-sectional shape of the potential field 
is an important consideration. First consider the potential field which results from using the two 
layer relaxation method as presented. Consider an arbitrary point, n a , in operational space and 
the associated optimal lattice-path, p ga = {ni, • • • , nyy}, from the goal to n 0 . Recall the relaxation 
equation for the overall potential from equation 9: 

+ !) = Hi + + $ n(*)J ( 10 ) 

In steady state, at any point, nj = ni • • *n;v, along the path, p ga} we can rewrite this relaxation 

equation as 

+ dn J + for J > 1 fU) 

K = 0 

where d nj £ {l,\/2} is the lattice distance between nj and j. The solution to this equation is 

K. = £ (K, + <U,) ( 12 ) 

J= 2 

First consider the case where n a is at the surface of an obstacle, i.e. tin € O and n;v-i & O. Recall 

that ax a*° where k 0 is the distance to the nearest obstacle. If 1, then d nj 

for nj near n a . This results in the geometric relation 

*£ = p!OT a N-j + v ( 13 ) 

Now consider the case where n a is far from any obstacle, thus, <C d n ^ . This yields the linear 

relation 

= k g + v ( 14 ) 

where k g is the distance from the goal to nj along the optimal path, p g j . In both cases, the constant 
v incorporates the barrier potential accumulated in the vicinity of other obstacles. 

At the expense of computational simplicity, the lattice relaxation method can be extended to 
obtain fields with other cross-sectional shapes. For example, we can modify the relaxation equation 
for to 

♦&(* +1) = s(f {*ij) + ne $in^ {d n + g- 1 (*£(*))}) (15) 
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By specifying different functions, /() and y(), the shape of the potential field can be altered. In 
order to retain a single local minimum, g() must be positive and monotonically increasing. The 
function /() need only be positive. The solution to equation 15 is 


<J> 


D 


= 9 


(n/K) 



(16) 


3.4 Potential Field Interpolation 


The potential field calculated above is defined only at lattice points (grid square centers). To obtain 
a continuous field, it is necessary to interpolate between these points. Interpolation can be 

accomplished using the bilinear form: 
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x — 8i 
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) + *S«tO - ¥> + •&»(! - T >T + •UTT 


(17) 


This formula represents nothing more than a weighted average of the field at the 4 nearest lattice 
points. The weights are dependent on the distances to the lattice points along the x and y axes. 

The interpolation described in equation 17 can be implemented in hardware in the following 
manner: The output, of each processor is connected to a common output summing node via 
a cascade of 2 attenuators. The 2 attenuation levels are set by row and column selector levels. For 
any given (x, y) access, 2 row selectors and 2 column selectors are set to attenuation values between 
0 and 1, all other row and column selectors are set to 0. The interpolated field value is produced at 
the output of the summing node. A few properties of the interpolation formula and of the resulting 
continuous field, follow. 


Lemma 4 If is omitted in the calculation of and there is a unique goal , tiq, then the 
lattice field , 4>fj, does not contain any two points, n a and n both extended-lattice path-connected 
to no, such that n a £ Ns(rib) an d $n a = 

Proof. Assume that there are two such points. Then there must be two minimum distance paths, 
p Ga and pGfc, connecting each of the two points to the goal such that there are an equal number of 
diagonal path-segments and an equal number of non-diagonal path-segments in the two paths. A 
diagonal path segment can be replaced by two non-diagonal path segments without affecting the 
proof. Thus there must be a closed path, {pGatPabyPbG} with an odd number of path segments. 
However it is impossible to have such a closed path with an odd number of segments. ■ 
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Lemma 5 If$fj is omitted in the calculation of&?j, and there is a unique goal \ tiq, the contin- 
uous field, contains a unique local minimum , no- 

Proof. The interpolation function of equation 17, within the region, 0 < (x — i6) < 6 and 
0 < (y — jS) < 5, is bilinear in x and y. Thus, minima must occur on the boundary of this region. 
Hence, local minima of <J>£ y must occur on the line segments connecting neighboring lattice points 
(in the JV 4 Q sense). By lemma 4, neighboring lattice points cannot have equal values of so 
minima must occur at lattice points themselves. By the piecewise bilinearity of such a con- 
tinuous local minima at a lattice point implies a lattice local minima at that point. However, by 
lemma 3 , this can only occur at no. m 


If is included in the calculation of •, then lemma 5 can be modified to show that 
has a unique local minimum except for the possible occurance of an equi-potential trough of length 
6 occurring between two neighboring lattice points having equal value. However, recall that the 
lattice potential field itself has a unique local minimum, and the length of the trough can be made 
arbitrarily small by increasing the resolution of the lattice. 


4 Feedforward Neural-Controller 

So far we have only concerned ourselves with various potential fields and have made no mention 
about how the fields are to be used to control the truck or similar autonomous vehicle. In this 
section we develop a feedforward neural network capable of using the potential field to control and 
navigate the truck to the goal. 

4.1 Controller Structure 

Previous work by Nguyen and Widrow [6,7] has shown that a feedforward neural network can 
successfully be trained to implement a nonlinear state feedback controller for backing a trailer- 
truck to a loading dock. The two segmented truck in consideration had the following state and 
control vectors (fig. 7). 

State = [^trailer y Vtrailcr^ trailer y @cab\ 
control = [(^steering] 

We refer to 6 cab - 0 trai i e r as the jack angle, 0 jack . In the work of Nguyen and Widrow, the state 
vector (and 2 redundant inputs) were used as the controller input. This input vector was chosen 
to provide the controller with the necessary information to solve the backing problem. For the 
navigation problem, the previous choice of controller inputs is clearly not sufficient; information 
about obstacles must be provided to the controller. Attempts were made to use the previous 
controller input definition with a single, fixed obstacle and learn the obstacle position implicitly . 

a F. Beaufays, personal communication, Stanford University, 1990 
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Although this scheme was able to steer the truck clear of an obstacle, extension to multiple obstacles 
was not feasible. Furthermore, the method required retraining for each new obstacle position. 



3 e 


steenng 


Figure 7: Truck state variables and field interpolation points. 

In developing an alternate set of controller inputs, a set of field interpolation points, {$t}i 
configured in a circle about the rear of the truck was defined in the local coordinate system of the 
truck (fig. 7). During each discrete control cycle, the local coordinates of the set of points, {s,}, 
were converted into global coordinates by the appropriate transformation. The field value, 
was measured at these locations giving the set {^^}* The difference between the field level at each 
of the outer points and the level at the center point (fig. 7), was computed: 

= -$? # for: = l -AT (18) 

1 "center 

The vector 

As = [Ai, • • • , A/v] (19) 

gave a measure of the directional derivative of the potential field in N directions. This vector, 
combined with 0j a ck and appropriately scaled, constituted the input vector to a 2-layer, sigmoidal 
feedforward network with 20 hidden units (fig. 8). The overall navigation— control structure, in- 
cluding this feedforward network and the 2-layer lattice network described previously, is shown in 
figure 9. 

4.2 Controller Training 

Training of the feedforward neural-controller was performed using backpropagation-through-time 
in an obstacle-free operational space. First, was computed for this space. Note that, since 
there were no obstacles, = 0 and consisted simply of the distance-to-goal measure. The 
truck was then placed in random initial configurations within the space and trained to back to the 
goal, while minimizing 0j ac k- Training was carried out as in the work of Nguyen and Widrow [7] 
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Figure 8: Structure of the neural- controller consisting of feedforward network and scaling factors. 
except that the docking-angle constraint was lifted by setting 

[^x j > ^0 C ] = [ x dock ~ % final) V dock V final} 0, 0] “h 0jacfc[O> 0> 

Imposing the first term caused the truck to dock with the goal while imposing the second term 
caused the controller to minimize the angle between the cab and trailer, thus preventing jack- 
knifing. Training required about 1000 complete docking cycles, with initial conditions being chosen 
progressively further from goal and at larger offset angles. When the truck was then placed in 
an operational space with obstacles, the obstacles warped The truck was now able to nav- 

igate around obstacles without any further training. The truck trajectories from different initial 
conditions in the sample obstacle space are shown in figures 10 and 11. 

Consider what task-knowledge was gained by the feedforward network during the training pro- 
cess which permitted it to successfully vise to navigate. If the controller had been provided 
with only truck state information, the controller would have learned the task of directly driving 
the state vector to zero, knowledge which would not have permitted obstacle avoidance. However, 
the particular choice of controller inputs, \8j a ck j As], led to different task-knowledge. Previously 
we mentioned that the desired truck behavior was to follow the negative gradient of the potential 
field, — In figure 10, the desired behavior is evidenced. Enough information is provided in 

As to accomplish the navigational task. 



Figure 9: Overall navigation/ control structure comprised of a two-layered systolic array , a lattice 
interpolation function, and a feedforward network controlling truck steering. 
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Figure 10: Truck trajectories from two initial conditions in the sample obstacle space. 



Figure 11: Trajectories showing desired behavior of driving "uphill” when obstacle configuration 
prevents driving "downhill. ” 
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However, the truck dynamics do not permit motion in arbitrary directions. Hence, simply 
following — V<$ xy is not always feasible, nor necessarily desirable. In figure 11, initial condition 2, 
the truck is started in a narrow corridor facing the wrong way. The truck backs uphill first before 
circling around the obstacle. This is correct since attempting to turn around sharply, trying to 
immediately follow — would result in a collision. 

In reality, the feedforward network combined the objective of following —V$ xy with the dy- 
namic constraints of the truck, thus attempting to minimize the directional derivative of within 
an arc of feasible directions. This was done while minimizing 0j ac *. It is interesting to observe that 
this complex behavior was learned in an obstacle-free space. 


5 Conclusion 

A hybrid-network method for obstacle avoidance in the truck-backing system of Nguyen and Widrow 
has been presented. The method uses a relatively simple, low-level algorithm easily implemented 
in hardware or software. 

A key advantage of the technique is the separation of the systolic array structure from the 
feedforward network. The systolic array computations are independent of the truck dynamics, 
constraints, etc., and serve simply to distribute information about goal and obstacle locations. 
These computations, carried out in parallel, are quick. In the examples given, the systolic array 
converged in less than 40 cycles. It is important not to view this procedure as path-planning. Path- 
planning requires consideration of both obstacle locations and truck configuration. There is actually 
no path-planning being done, as the computations serve only as a mechanism for distributing 
information. The feedforward neural network, on the other hand, is trained independently of any 
particular obstacle configuration and thus can be held fixed after initial training. No additional 
training is needed when a new obstacle pattern is presented. 

Currently, grid-squares are either impenetrable obstacles or completely free. The technique 
presented can easily be extended to handle variable terrain difficulties by making and 4>£ ax 

vary for each obstacle square. This could be used, for example, to avoid rocky terrain if a clear 
path was available, yet allow the rocky terrain to be crossed if it constituted the only path. Specific 
choices of 3>* aa; d e P en d on the trading-off of terrain difficulty and path length. 

In situations where tight maneuvering is necessary to negotiate obstacles, the method presented 
may fail. It would, in those cases, be desirable to further train the feedforward network in the 
presence of obstacles to tune the control. This might also require additional sensory input to the 
controller. One may also observe that the method could generate a path which passes through a 
barrier aperture too narrow for the truck to fit through. It is envisioned that the truck controller 
could determine this while navigating. When such an aperture is encountered, the controller could 
modify the obstacle space description by increasing the local obstacle level (the input to the 1 st 
layer of the systolic array) until the potential field shifted to favor a different direction. This could 
be accomplished in real-time due to the speed of convergence of the array computations. 


18 



The systolic array requires obstacle information for the entire space in which navigation is to 
occur. In the case where the vehicle must navigate over a long distance for which the entire obstacle 
space is not known, the method could be used to perform local path-planning assuming that the 
general desired direction of travel is known. 

Currently, work is underway to extend the technique presented to include a docking angle 
constraint and eventually to maneuver multiple linked objects, such as a robotic arm. This would 
involve “path-planning” for multiple points on the object. Work is also being done to characterize 
the warping of resulting from multiple minimization criteria. 
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